research advanc technolog digit librari abstract commun collabor peopl major theme inform seek process collabor queri address issu share user search experi user formul queri search engin paper describ collabor queri system help user queri formul find previous submit similar queri mine web log system oper cluster recommend relat queri user hybrid queri similar identif approach system emploi graph base approach visual queri recommend dynam genr domain intent factor affect click dthrough behavior aggreg search interfac quantum theori bring inform retriev examin inform retriev process induct perspect ladi experiment evalu learn aggreg function expert search entiti geometri exploit multipl sourc support relev predict filter document subspac entiti geometri exploit multipl sourc support relev predict knowledg model prior art search rethink preserv valid preserv object repositori risk ontolog porro feder aggreg search explor multidimension represent document queri extend version current research focus retriev result aggreg abstract focus retriev result aggreg provid user answer inform pointer document focus retriev identifi relev document part document relev reduc time take user navig document result aggreg fulfil user draw inform sourc collect document part document aggreg singl result reduc time take user fulfil inform special issu includ paper show breadth depth current state research branch inform retriev includ descript live result aggreg system experiment focuss retriev system includ sentenc retriev question answer entiti rank metric passag retriev introduc special issu provid overview work present paper xml retriev evalu context specif about xml retriev quantum dbase model interact inform retriev structur inform retriev quantum theori visual problem inex topic task dbase evalu aggreg search interfac abstract paper present user studi evalu effect aggreg search interfac context navig search task experiment system develop present search result aggreg multipl inform sourc compar convent tab interfac sixteen particip recruit evalu perform interfac result suggest aggreg search interfac promis support nonnavig search task quantiti divers retriev item particip access complet task increas aggreg interfac particip found aggreg present easier access retriev item find relev inform compar convent interfac relationship structur text retriev structur weight exist rank scheme assum term occurr document equal influenc intuit term occur place greater influenc occurr abstract import occurr bodi text observ remain issu find good weight structur vector space probabl okapi bm rank extend includ structur weight weight select trec wsj collect genet algorithm learn weight test evalu set queri structur weight vector space product structur weight probabilist retriev show improv averag precis unstructur counterpart structur weight bm show improv analysi suggest bm improv structur weight structur document retriev focuss structur document retriev aim retriev entri point user brows access relev document compon document structur paper report develop implement evalu entri point retriev strategi deriv user studi design elicit constitut entri point term statist structur text retriev xml retriev quantum dbase model interact inform retriev extend version intern symposium inform interact context intern symposium inform interact context proceed intern confer inform interact context focus access xml document narrowcast de current develop inform technolog lead increas captur storag inform peopl activ rais issu preserv privaci paper examin issu import introduct ubiquit comput technolog work environ problem privaci close relat wai technolog attenu natur mechan feedback control inform releas describ framework design privaci ubiquit comput environ conclud applic introduct inform technolog store transmit manipul vast quantiti varieti inform whilst potenti essenti govern public servic busi individu permit entail unobtrus access manipul present person data parker al dunlop amp kl structur relev common basi evalu structur document retriev narrowcast de current develop inform technolog lead increas captur storag inform peopl activ rais issu preserv privaci paper examin issu import introduct ubiquit comput technolog work environ problem privaci close relat wai technolog attenu natur mechan feedback control inform releas describ framework design privaci ubiquit comput environ conclud applic introduct inform technolog store transmit manipul vast quantiti varieti inform whilst potenti essenti govern public servic busi individu permit entail unobtrus access manipul present person data parker al dunlop amp kl gener queri dbias concept content structur queri reformul locat relev text xml document tradit document retriev shown competit approach xml element retriev counter intuit element retriev task request relev document part retriev paper conduct compar analysi document element retriev highlight rel strength weak approach explain rel effect document retriev approach element retriev task sound complet relev assess xml retriev inform retriev research compar retriev approach requir test collect consist document user request relev assess obtain relev assess sound complet crucial comparison retriev approach xml retriev problem obtain sound complet relev assess complic structur relationship retriev result major differ xml retriev flat document retriev relev element retriev unit independ relat element major consequ gather relev assess paper describ investig creation sound complet relev assess evalu content orient xml retriev carri inex evalu campaign xml retriev campaign seventh year substanti approach gather assess final settl highlight method mark relev passag document object collect assess element level method gather assess inex discuss contrast highlight method shown reliabl method categori subject descriptor workshop aggreg search singapor paper present session fourth session joint workshop aggreg search singapor paper present session fourth session joint compar evalu xml inform retriev system inex understand xml retriev evalu xml logic structur retriev multimedia object topic shift focuss access xml repositori featur queri dbase tabl content gener xml document combin evid relev criteria framework experi web retriev combin multipl sourc evid xml multimedia document infer network incorpor element languag model combin multipl sourc evid xml multimedia document infer network incorpor element languag model overview inex ad hoc track abstract paper overview inex ad hoc track main purpos ad hoc track investig intern document structur provid xml markup retriev relev inform reason retriev result liber arbitrari passag measur chosen fairli compar system retriev element rang element arbitrari passag inex ad hoc track featur task focus task rank list overlap result element passag need relev context task overlap result element passag return group articl context task singl start point element start tag passag start articl need discuss result task examin rel effect element passag retriev examin context content keyword search content structur ca structur search inex evalu measur abstract paper describ offici measur retriev effect emploi ad hoc track inex earlier year xml element retriev result format liber arbitrari passag respons inex measur base amount highlight text retriev lead natur extens establish measur precis recal measur defin focus task evalu interpol precis recal ip term highlight text retriev relev context task evalu averag gener precis magp whereth gener score articl base retriev highlight text context task evalu averag gener precis magp gener score articl base distanc assessor entri point overview inex entiti rank track storybank indian villag commun digit librari start read textual xml document structur inform retriev aim exploit document structur retriev relev compon allow user straight relev materi paper call entri point bep intend give user start point access relev inform document examin relationship bep relev compon inex ad hoc assess main find document short assessor choos entri point distanc start document entri point coincid relev charact relev document show strong relat bep relev text find brows bep articl singl relev passag contain bep context bep articl relev passag evalu relev context document retriev twist examin topic shift content dorient xml retriev xml retriev db fir theori web practic learn dbase summaris xml document document format extens markup languag xml collect document type paper present approach summaris xml document novelti approach li base featur content document logic structur follow machin learn sentenc extractionbas summaris techniqu find featur effect produc summari approach view sentenc extract order task evalu summaris model inex summac dataset result demonstr inclus featur logic structur document increas effect summaris learnabl system effect suit task summaris context xml document approach gener applic entir document element vari granular xml tree view result step intellig summaris xml document examin topic shift content dorient xml retriev evalu xml retriev effect inex advanc inform retriev paper captiv reader present overview topic detect track tdt problem purpos organ broadcast new stori real world event discuss paper describ research problem consid phase tdt focus solut develop ciir problem detect problem identifi topic appear new stream approach discuss practic technic interest present algorithm modif exist ir techniqu tdt problem advanc xml inform retriev evalu investig exhaust dimens content dorient xml element retriev evalu inex evalu initi content orient xml retriev establish defin relev element grade dimens exhaust specif measur exhaust xml element discuss topic request specif measur focus element topic request obtain relev assess costli task xml retriev problem exacerb element document assess respect exhaust specif dimens continu discuss inex sophist definit relev exhaust dimens need paper attempt answer question extens statist test compar conclus system perform made assess scenario summari xml retriev abstract avail logic structur document contentori xml retriev benefici user xml retriev system research structur document retriev systemat examin structur facilit search process user investig user xml retriev system support search process summaris answer question interact inform retriev system develop studi human searcher conduct result show searcher activ utilis provid summari summari usag vari level xml document structur result implic design interact xml retriev system progress inform retriev econom feasibl maintain larg databas document imag creat tremend demand robust wai access manipul inform imag attempt move paper offic larg quantiti print document scan archiv imag adequ index inform provid tradit databas index retriev capabl fulli convert document electron represent index automat factor prohibit complet convers includ high cost low document qualiti fact text compon adequ repres convert form case advantag maintain copi document imag form paper provid survei method develop research access manipul document imag complet accur conv overview inex abstract inex work goal establish infrastructur form larg xml test collect score method evalu content orient xml retriev system paper overview work carri part inex inex evalu measur abstract paper describ offici measur retriev effect emploi ad hoc track inex topic shift xml retriev inex advanc xml retriev inex initi investig summaris interact xml retriev number compon xml document larger flat document essenti provid user xml inform retriev system overview content retriev element paper investig summaris xml retriev mean help user search process scalabl framework multimedia knowledg manag manag user expect xml element retriev strict vagu interpret xml dretriev queri structur hint queri xml dretriev extend cumul gain measur evalu content dorient xml retriev special issu model design entri point structur document retriev part characterist entri point structur document retriev part ii type evalu effect content dorient xml retriev method report ad dhoc track inex workshop sigir workshop program xml search languag inex score advanc xml inform retriev learn summaris xml document content structur inex evalu measur abstract paper describ offici measur retriev effect emploi inex extend cumul gain xcg measur addit result correl analysi report examin correl emploi quantis function measur inex ad hoc task overview inex abstract inex work goal establish infrastructur form larg xml test collect score method evalu content orient xml retriev system paper overview work carri part inex inex evalu measur abstract paper describ offici measur retriev effect emploi inex extend cumul gain xcg measur addit result correl analysi report examin correl emploi quantis function measur inex ad hoc task inex multimedia track interpret ca abstract debat interpret structur queri structur hint inex interpret sca user target element interpret strictli vca interpret vagu wai queri interpret investig inex discuss interpret propos compar queri interpret ssca svca vsca vvca interpret interpret target element support element strictli vagu analysi submit run show share interpret target element correl previou decis divid ca sca vca inex sound analysi support fact perform vsca run submit vvca task perform svca run submit ssca task model good entri page web metadata model support scalabl interact tv servic paper introduc metadata model describ scalabl interact tv servic enrich supplement multimedia inform model user access tv servic tradit tv set addit mobil devic tabletpc pda achiev segment tradit linear program compon separ devic independ devic specif metadata realiz model build exist standard tv anytim mpeg mpeg model achiev step connect world vision specif phase tv anytim forum xml multimedia retriev guest editori space introduct special issu inex provid consist exhaust relev assess xml retriev evalu report inex workshop element retriev methodolog provid consist exhaust relev assess xml retriev evalu interfac pour valuat de syst me de recherch sur de document xml model xml retriev belief function studi assess relev inex test collect investig assess trend inconsist collect relev assess inex test collect order provid critic analysi emploi relev criterion assess procedur evalu content orient xml retriev approach model vagu content structur queri xml retriev probabilist object drelat framework xml retriev applic requir relev orient rank retriev element order captur vagu inher inform retriev process relev orient rank support vagu content level structur level paper probabilist object relat framework model represent retriev strategi account vagu content structur level approach make establish databas technolog combin sound probabl theori allow fast flexibl prototyp represent retriev strategi overview inex reliabl test xcg inex metric abstract paper compar effect score system rank obtain inex metric offici measur inex xcg metric propos develop comparison simul run easili deriv desir system rank reliabl measur produc base predefin set user prefer result xcg metric suit compar system inex content task system aim return highest score element user prefer reflect quantis function aim avoid return overlap compon toler irrelev user deffort evalu retriev system predefin retriev unit integr xlink xpath retriev structur multimedia document digit librari support retriev multimedia data user inform multimedia inform retriev digit librari base semant primit featur multimedia object paper investig intersect hierarch link structur inform content inform support retriev multimedia data digit librari base xml format purpos integr xlink xpath inform exploit intersect hierarch link inform xml base multimedia document overlap problem content dorient xml retriev evalu initi evalu xml retriev inex number metric evalu effect content orient xml retriev approach develop metric provid solut address problem overlap result element problem overlap refer compon recal base lead skew effect score propos altern metric aim provid solut overlap issu combin evid web retriev infer network model experiment studi report year initi evalu xml retriev articl provid overview round inex initi report inex workshop paper report work present discuss workshop automat identif entri point focus structur document retriev construct test collect focuss retriev structur document abstract paper examin methodolog issu involv construct test collect structur document obtain entri point evalu focuss retriev document compon describ pilot test propos test collect construct methodolog perform document collect shakespear plai analysi examin effect queri complex type queri difficulti multipl relev judg queri problem obtain exhaust relev assess particip method elicit relev assess entri point find methodolog feasibl small scale context merit investig inex evalu initi introduct widespread extens markup languag xml web digit librari brought explos develop xml tool includ system store access xml content number system increas assess benefit user benefit user depend larg aspect user interact system consid aspect includ respons time requir user ort usabl system abil present user desir inform user base decis satisfi system prioritis combin factor initi evalu xml retriev inex set begin aim establish infrastructur provid mean form larg xml test collect score method evalu content ori dvalu knowledg augment structur document retriev mathemat paper focu translat model problem turn problem address issu concern reader estim pr pr fle estim pr elf directli interest probabl wouldn reduc problem direct approach estim pr fle adequ turn process estim pr elf understand imagin divid french english string form ill form precis notion mind string il va la bibliothqu live hous colorless green idea sleep furious form string lava bibliothqu live hous translat french string english spring form french string sea form english string hope land good import model pr elf concentr probabl wellform english string import model pr fle concentr probabl form french string reduc probabl form french string factor spread probabl liber ill form french string effect translat argument maxim function maxim cf posit constant translat model prodig sprai probabl place ill form french string fact discuss section proceed workshop initi evalu xml retriev inex prefac widespread xml digit librari product catalogu scientif data repositori web prompt develop retriev search brows method xml document turn led evalu develop xml retriev system part larg scale effort improv effici research inform retriev digit librari initi evalu xml retriev inex start intern coordin effort promot evalu procedur content base xml retriev aim inex initi provid mean form larg xml test collect score method evalu xml retriev system year evalu effort particip organis contribut build larg scale xml test collect creat topic perform retriev run provid relev assess relev dimens xml compon vari granular inex workshop held schloss dagstuhl research centr conclud result larg scale effort summaris address encount issu devis workplan evalu xml retriev system workshop brought research field xml retriev research particip inex workshop organis present workshop session present session particip opportun present approach xml index retriev workshop session serv discuss forum review issu relat creation inex topic specif retriev result submiss format definit relev dimens onlin assess system provid inex result discuss provid valuabl input organis inex final workshop evalu measur aim provid forum develop guidelin procedur evalu xml retriev system base emploi relev dimens result discuss evalu metric implement appli inex submiss proceed collect paper describ research inex particip paper group approach xml retriev report categori defin definit ir orient research group focu extens specif type inform retriev ir model appli standard ir test collect past deal xml document db orient group work extend databas db manag system deal semistructur data access dimens structur document retriev structur document retriev aim retriev document compon satisfi queri retriev predefin document unit paper report investig idf acc approach tf idf classic term fi equenc invers document frequenc acc paramet call access captur structur document tf idf acc approach defin probabilist relat algebra investig retriev qualiti estim acc valu develop method automat construct divers test collect structur document standard test collect experi carri combin web document represent bayesian infer network model link content dbase evid formal model data fusion video retriev mpeg base infer network work propos model video retriev base infer network model document network construct video metadata encod mpeg captur inform pertain structur aspect video breakdown shot scene conceptu aspect video scene shot content contextu aspect context inform posit conceptu content document retriev process exploit distribut evid shot perform rank level granular address idea evid inherit evalu exploit contextu inform perform constrain queri focuss structur document retriev focuss structur document retriev aim retriev entri point user brows access relev document compon document structur paper report develop implement evalu entri point retriev strategi deriv user studi design elicit constitut entri point dempster dshafer theori evid combin aspect inform paper propos model relev feedback model combin evid user relev assess algorithm describ word document motiv dempster shafer framework theori model combin evid model incorpor uncertain natur inform retriev relev feedback discuss sourc uncertainti combin evid inform retrievel import combin evid relev feedback present result seri experi highlight aspect approach discuss find combin select characterist inform paper report seri experi design investig combin term document weight function inform retriev describ seri weight function base inform document collect weight function type experi base combin evid ad hoc retriev base select combin evid relev feedback situat discuss difficulti involv predict good combin evid ad hoc retriev suggest factor lead success failur combin demonstr relev feedback situat relev assess provid good indic evid select queri term weight relev inform guid combin process shown reduc variabl inher combin evid report acm sigir workshop mathemat fformal method inform retriev report acm sigir workshop mathemat fformal method inform retriev empir investig queri modif abduct explan paper report seri experi design investig queri modif techniqu motiv area abduct reason notion abduct explan explan descript data highlight import featur data describ method creat abduct explan explor term reweight queri reformul techniqu demonstr suitabl relev feedback model represent focuss retriev structur document base fuzzi aggreg effect retriev structur document exploit content structur knowledg document knowledg focu retriev entri point document compon relev inform user brows retriev relev compon enabl suitabl represent method develop paper present model repres structur document focuss retriev model found fuzzi aggreg approach base fuzzi represent linguist quantifi order weight averag oper defin represent document compon fuzzi aggreg relat compon arriv document represent support select entri point broadcast technolog dissemin cultur heritag logic uncertainti inform retriev logic inform retriev ir enabl formul model gener ir model concept graphic user interfac hypermedia retriev concept gener specif support hypermedia retriev present paper graphic user interfac make explicit kei concept hypermedia retriev content document fact document structur document underli model base probabilist object orient logic pool enabl content base queri fact base queri exploit structur natur hypermedia document paper focu graphic user interfac reflect express pool queri hypermedia document report plicat system heterogen collect hypermedia document dempster dshafer index focus retriev hierarch structur document space implement experi web museum collect improv formal model usabl research ir glasgow univers introduct combin document represent acm sigir workshop mathemat fformal method inform retriev probabilist descript dorient approach categor web document select relev feedback term characterist paper present relev feedback techniqu select combin evid base usag term document term document describ featur make document relev improv retriev effect paper present initi experiment investig techniqu incorpor exist measur describ inform content document result experi posit support hypothesi extend relev feedback account term document improv perform relev feedback introduct characterist digit librari larg divers collect access method collect support user search inform access method provid wider rang techniqu user make framework investig interact inform retriev increas retriev effect inform retriev system offer support user inform seek activ achiev major concern obtain understand natur interact user inform retriev system mean analys interact inform retriev compar interact process inform retriev system present framework investig interact user inform retriev system framework base channel theori theori inform flow explicit ontolog repres aspect interact process develop framework investig interact inform retriev desir level abstract framework investig interact queri reformul standard web search model repres retriev heterogen structur document base evidenti reason document displai intern structur compos compon journal articl paragraph tabl structur document retriev unit document compon document compon structur document type media locat number site written languag inform retriev model heterogen structur document account dispar document compon present model repres retriev heterogen structur document multimedia distribut multilingu document model base evidenti reason formal theori represent combin knowledg knowledg content document compon show model represent retriev inform retriev dempster dshafer theori evid dempster dshafer model document retriev noun phrase paper propos document retriev system base natur languag process document queri singl term term group index element repres document queri model formal express dempster shafer theori evid discuss detail theori repres document collect index element document queri retriev function deriv directli underli theori present implement model experiment work carri report introduct document retriev dr system focu problem retriev document relev user inform repres queri work concentr text base system tradit dr model repres document queri set keyword handl divers human languag simplist represent approach document relev survei probabilist model inform retriev articl survei probabilist approach model inform retriev basic concept probabilist approach inform retriev outlin principl assumpt approach base present model propos develop ir classifi compar common formal approach constitut basi futur research logic model inform retriev introduct overview logic model inform retriev process establish research area peopl inform retriev commun work perform area understand logic formal connect logic inform retriev paper aim resolv problem introduc formal logic model inform retriev show logic build model present overview current logic model inform retriev introduct argu current inform retriev ir model offer simplist specif represent inform chiaramella chevallet nie van rijsbergen develop formal model ir system gener manner captur inform dempster dshafer theori evid appli structur document model uncertainti document displai structur determin author chapter chapter take account structur document retriev process focu part document relev inform chiaramella al advanc model index retriev structur document aim express model framework base formal logic theori develop logic formal model paper add model theori uncertainti dempster shafer theori evid shown theori rule dempster combin rule express uncertainti respect part document compat logic model develop chiaramella al short queri ad hoc queri short ten term previou round trec concentr obtain optim perform long trec topic paper investig behaviour similar measur short queri show experiment success measur give similar good perform long trec topic work short queri explor method achiev greater effect short queri conclud success approach combin similar measur evid briefli describ experi spanish data introduct user interact text retriev system pose short queri typic word experi user real system pose queri unsatisfi behaviour standard similar measur cosin report answer appar correspond inform calculu inform retriev inform retriev situat theori paper essai convinc reader situat theori present characterist adequ studi ir concentr experi situat theori dempster dshafer theori evid inform retriev 